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The  growing  importance  of  software  in  delivering  military  capabilities  to  the  wa  fighter  increases  the  need  for  the  DoD  to 
identify  and  support  software-specific  competencies  for  the  acquisition  workforce.  To  help  address  this  challenge,  the  Software 
Acquisition  Training  and  Education  Working  Groip  (SATEWG)  is  defining  competencies for  each  acquisition  career field, 
and  reviewing  software  acquisition  curricula  against  these  competencies.  This  article  provides  insight  into  the  problems  being 
addressed,  the  SATEWG ’s  approach  to  these  challenges,  and  their  accomplishments  to  date. 


The  complexity  and  criticality  of 
defense  software  poses  a  significant 
challenge  to  the  acquisition  workforce  as 
well  as  the  human  capital  experts  who 
need  to  ensure  that  the  workforce  has  the 
right  competencies  to  deliver  this  essential 
capability  to  the  warfighter.  Add  to  this 
the  task  of  identifying  cross-functional 
software  competencies  that  are  critical 
for  acquisition  professionals,  and  you 
have  the  primary  challenges  facing  the 
SATEWG. 

There  have  been  a  number  of  initia¬ 
tives  aimed  at  improving  DoD  acquisi¬ 
tion  outcomes  over  the  years,  which 
have  subsequently  impacted  the  acquisi¬ 
tion  workforce.  In  the  mid-’90s,  the 
DoD  adopted  a  policy  encouraging  the 
use  of  commercial  products — rather 
than  those  developed  to  military  specifi¬ 
cations — in  order  to  take  advantage  of 
the  innovation  available  in  the  commer¬ 
cial  marketplace.  Commercial  standards 
became  preferred  over  military  stan¬ 
dards.  The  government  moved  toward 
specifying  the  expected  performance  of 
a  system,  rather  than  telling  contractors 
how  to  build  it. 

In  the  ’90s  era  of  declining  defense 
budgets,  policymakers  expected  acquisi¬ 
tion  reform  to  bring  about  greater  effi¬ 
ciencies  in  order  to  pay  for  defense 
acquisition.  The  Federal  Acquisition 
Reform  Act  (FARA)  of  1996  called  for 
greater  efficiencies  in  defense  acquisi¬ 
tion  [1],  The  FARA  eliminated  15,000 
members  of  the  defense  acquisition 
workforce,  and  called  for  reductions  of 
25  percent  over  the  following  five  years. 
The  focus  of  the  defense  acquisition 
workforce  shifted  ostensibly  from  engi¬ 
neering  of  systems  to  systems  acquisi¬ 
tion.  The  numbers  of  acquisition  per¬ 
sonnel  dwindled  and  systems  became 
larger  and  more  complex,  creating  sig¬ 
nificant  challenges  for  defense  acqui¬ 
sition.  These  challenges  were  thrown 
into  the  spotlight  by  Government 


Accountability  Office  (GAO)  annual 
audits  [2]. 

The  acquisition  reform  pendulum 
started  swinging  the  other  way  when,  in 
2003,  the  DoD  started  an  effort  to  rein¬ 
vigorate  systems  engineering  in  defense 
acquisition.  In  2009,  the  Secretary  of 
Defense  proposed  hiring  20,000  new 
acquisition  professionals  by  the  year 
2015  [3].  The  Weapon  Systems  Acqui¬ 
sition  Reform  Act  of  2009  established 
new  Directors  for  Systems  Engineering 


“The  application  of 
modern  software 
technologies  and  the  use 
of  sound  software 
engineering  practices  ... 
are  important  elements 
of  program  execution.  ” 

and  Developmental  Test  and  Evaluation 
and  called  for  reports  on  these  parts  of 
the  defense  acquisition  workforce  [4]. 
The  challenge,  however,  continues  to  be 
that  software  engineering  is  not  current¬ 
ly  designated  by  a  standalone  occupa¬ 
tional  career  code,  nor  is  it  managed 
within  the  acquisition  workforce  as  its 
own  career  field. 

The  evolution  of  acquisition  policy 
has  had  a  significant  impact  on  the 
acquisition  workforce  and  their  ability  to 
manage  software  acquisition. 

Software-Specific  Human 
Capital  Challenges 

Software  is  a  unique  and  critical  compo¬ 
nent  in  the  products  of  DoD,  and  its 


reach  extends  across  the  acquisition 
career  fields  and  each  of  the  services  at 
varying  levels.  The  application  of  mod¬ 
ern  software  technologies,  and  the  use  of 
sound  software  engineering  practices 
over  the  acquisition  life  cycle,  are  impor¬ 
tant  elements  of  program  execution. 

The  DoD  conducted  the  first  phase 
of  a  software  industrial  base  study  in 
2006  [5],  finding  that  their  dependence 
on  larger,  more  complex  software  is 
increasing  the  risk  of  not  delivering  sys¬ 
tems  on  schedule  and  within  budget. 
Although  the  study  found  that  the 
nation’s  overall  number  of  software 
developers  was  adequate  for  the  near- 
term,  it  found  shortfalls  in  the  number 
of  top-tier  software  program  managers, 
architects,  and  domain  experts — with 
perhaps  as  few  as  500  having  the  skills  to 
develop  the  DoD’s  complex,  software¬ 
intensive  systems.  Though  the  software 
industrial  base  study  did  not  address  the 
acquisition  workforce  per  se,  it  is  safe  to 
say  that  these  shortfalls  in  top-tier  talent 
are  evident  there  as  well. 

It  should  be  noted  that  subsequent 
phases  of  the  software  industrial  base 
study  found  shortfalls  in  the  number  of 
adequately  trained  software  developers, 
which  was  the  primary  reason  the  Office 
of  the  Secretary  of  Defense  (OSD)  — 
Acquisition,  Technology  &  Logistics 
(AT&L)  sponsored  development  of  a 
reference  curriculum  for  graduate  study 
of  software  engineering  [6]. 

In  [7],  the  National  Defense  Indus¬ 
trial  Association  (NDIA)  recommends 
actions  including  the  broadening  of 
expertise  “to  enhance  cross-functional 
and  domain  knowledge  and  skills.”  It  is 
critical  that  the  DoD  begin  identifying 
and  embedding  the  basic  software  skills 
needed  for  each  career  field.  This  will 
reduce  the  reliance  on  software  experts 
while  increasing  the  overall  abilities  of 
the  acquisition  workforce. 

In  2006,  the  Navy  started  the 


4  CROSSTALK  The  Journal  of  Defense  Software  Engineering 


May /June  2010 


Report  Documentation  Page 

Form  Approved 

OMB  No.  0704-0188 

Public  reporting  burden  for  the  collection  of  information  is  estimated  to  average  1  hour  per  response,  including  the  time  for  reviewing  instructions,  searching  existing  data  sources,  gathering  and 
maintaining  the  data  needed,  and  completing  and  reviewing  the  collection  of  information.  Send  comments  regarding  this  burden  estimate  or  any  other  aspect  of  this  collection  of  information, 
including  suggestions  for  reducing  this  burden,  to  Washington  Headquarters  Services,  Directorate  for  Information  Operations  and  Reports,  1215  Jefferson  Davis  Highway,  Suite  1204,  Arlington 

VA  22202-4302.  Respondents  should  be  aware  that  notwithstanding  any  other  provision  of  law,  no  person  shall  be  subject  to  a  penalty  for  failing  to  comply  with  a  collection  of  information  if  it 
does  not  display  a  currently  valid  OMB  control  number. 

1.  REPORT  DATE 

JUN  2010  2.  REPORT  TYPE 

3.  DATES  COVERED 

00-05-2010  to  00-06-2010 

4.  TITLE  AND  SUBTITLE 

Influencing  Software  Competencies  Across  the  DoD  Acquisition 

Workforce 

5a.  CONTRACT  NUMBER 

5b.  GRANT  NUMBER 

5c.  PROGRAM  ELEMENT  NUMBER 

6.  AUTHOR(S) 

5d.  PROJECT  NUMBER 

5e.  TASK  NUMBER 

5f.  WORK  UNIT  NUMBER 

7.  PERFORMING  ORGANIZATION  NAME(S)  AND  ADDRESS(ES) 

Office  of  the  Director  of  Defense  Research  and  Engineering, 1851  S  Bell 
Street  #102, Arlington, VA, 22202 

8.  PERFORMING  ORGANIZATION 

REPORT  NUMBER 

9.  SPONSORING/MONITORING  AGENCY  NAME(S)  AND  ADDRESS(ES) 

10.  SPONSOR/MONITOR'S  ACRONYM(S) 

11.  SPONSOR/MONITOR'S  REPORT 
NUMBER(S) 

12.  DISTRIBUTION/AVAILABILITY  STATEMENT 

Approved  for  public  release;  distribution  unlimited 

13.  SUPPLEMENTARY  NOTES 

14.  ABSTRACT 

15.  SUBJECT  TERMS 

16.  SECURITY  CLASSIFICATION  OF:  17.  LIMITATION  OF 

_ _ _  ABSTRACT 

18.  NUMBER  19a.  NAME  OF 

OF  PAGES  RESPONSIBLE  PERSON 

a.  REPORT  b.  ABSTRACT  c.  THIS  PAGE  Same  OS 

unclassified  unclassified  unclassified  Report  (SAR) 

4 

Standard  Form  298  (Rev.  8-98) 

Prescribed  by  ANSI  Std  Z39-18 


Influencing  Software  Competencies  Across  the  DoD  Acquisition  Workforce 


Software  Process  Improvement  Initia- 
rive  (SPII),  which  identified  and  exam¬ 
ined  issues  preventing  software-inten¬ 
sive  projects  from  meeting  schedule, 
cost,  and/or  performance  goals  [8],  A 
survey  conducted  as  part  of  the  SPII 
effort  found  that: 

•  There  is  a  lack  of  adequately  educat¬ 
ed  and  trained  software  acquisition 
professionals  and  systems  engineers. 

•  There  are  no  established  education 
standards. 

•  Key  staff  experience  levels  are  below 
average. 

In  [8],  the  SPII’s  Human  Resources 
Focus  Team  recommended  identifying 
the  software  acquisition  training  needs 
tailored  to  the  respective  roles  and 
responsibilities  for  six  acquisition  career 
fields:  program  management,  systems 
and  software  engineering,  acquisition 
logistics,  contracting,  legal,  and  test  and 
evaluation  engineering.  They  also  rec¬ 
ommended  that  the  DoD  use  the  find¬ 
ings  of  the  report  as  a  baseline  to  ana¬ 
lyze  the  software  competencies  and 
training  of  the  acquisition  workforce  [8] . 

In  February  2008,  the  DoD  estab¬ 
lished  the  SATEWG  to  develop  soft¬ 
ware  competencies  for  the  entire  acqui¬ 
sition  workforce — not  just  software 
experts — starting  with  program  man¬ 
agers  and  systems  engineers  [9].  In  addi¬ 
tion,  the  SATEWG  was  chartered  to 
develop  and  initiate  a  plan  to  address  the 
gaps  in  the  existing  software  acquisition 
curricula.  The  SATEWG  is  comprised 
of  individuals  from  different  organiza¬ 
tions  with  the  goal  of  promoting,  across 
the  DoD,  collaboration  focusing  on 
software  and  human  capital  initiatives 
for  the  acquisition  workforce. 

SATEWG  Membership 

The  SATEWG  is  comprised  of  repre¬ 
sentatives  from  organizations  designated 
by  the  Under  Secretary  of  Defense 
(AT&L),  and  others  including  the  OSD, 
Army,  Navy,  Air  Force,  Defense 
Acquisition  University  (DAU),  Air  Force 
Institute  of  Technology,  SEI,  and 
Sevatec,  Inc. 

Each  of  these  organizations  plays  a 
role  in  developing  or  supporting  compe¬ 
tencies  and  curricula,  and  their  active 
participation  has  been  critical  to  the  suc¬ 
cess  of  the  group.  The  diversity  of  these 
stakeholders  has  made  for  a  stronger 
product.  There  are  two  types  of 
SATEWG  members:  core  team  mem¬ 
bers  and  advisors.  This  structure 
encourages  leadership  involvement  and 
provides  flexibility  for  varying  levels  of 
commitment. 


Developing  a  Software 
Competency  Framework 

A  key  challenge  for  die  SATEWG  was  to 
identify  aspects  of  software  engineering 
diat  are  truly  unique  to  software  and  rele¬ 
vant  to  the  broader  acquisition  workforce. 
For  example,  courses  often  address 
requirements  management  and  configura¬ 
tion  management,  but  they  do  not  neces¬ 
sarily  take  into  account  die  volatility  of 
software  requirements  or  the  potential  for 
spawning  a  multitude  of  slighdy  different 
software  configurations. 

Another  challenge  for  the  SATEWG 
was  to  identify  aspects  of  software  acqui¬ 
sition  general  enough  to  be  considered 
critical  by  the  broader  acquisition  work¬ 
force,  yet  specific  enough  to  support 
building  an  interdisciplinary  software  skill- 
set.  This  interdisciplinary  software  skill  set 
reduces  dependency  on  software  experts, 
which  in  turn  becomes  more  important  as 
die  acquisition  workforce  grows. 

The  SATEWG  created  an  overarch¬ 
ing  body  of  skills  called  the  software 
competency  framework.  It  is  used  as  the 
foundation  for  providing  input  to  the 
competency  models  specific  to  each 
acquisition  career  field,  and  as  a  source 
for  analyzing  existing  curricula.  During 


the  framework’s  development,  the 
SATEWG  reviewed  234  software  com¬ 
petencies  and  790  competency  elements 
from  the  following  sources: 

•  Existing  DAU  curricula. 

•  Competency  studies  and  reports 
conducted  by  the  services  (e.g.,  SPII) 
[8], 

•  Industry  best  practices. 

•  Existing  competency  models  such  as 
the  Software  Engineering  Body  of 
Knowledge  [10];  Systems  Planning, 
Research,  Development  and  Engi¬ 
neering  (SPRDE);  program  manage¬ 
ment;  and  IT  career  fields. 

The  framework  includes  the  compe¬ 
tencies  that  are  both  unique  to  software 
and  cross-functional  in  nature,  so  they 
can  be  generalized  for  the  various  acqui¬ 
sition  career  fields.  Many  software-relat¬ 
ed  competencies,  although  important, 
weren’t  deemed  by  the  SATEWG  as  dif¬ 
ferent  enough  from  the  other  disciplines 
to  be  included  in  the  framework — at 
least  from  the  perspective  of  the  acqui¬ 
sition  workforce.  For  example,  software 
specifications  are  certainly  different 
from  typical  system  specifications;  how¬ 
ever,  the  process  for  managing  these  dif¬ 
ferent  types  of  specifications  is  quite 
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similar  for  the  acquisition  workforce. 

The  SATEWG  also  reviewed  the 
persistent  software  development  and 
acquisition  issues  to  ensure  that  the 
competencies  identified  are  relevant  to 
the  pressing  needs.  This  review  included 
the  original  1968  NATO  efforts  defining 
software  engineering  [1 1]  as  well  as  the 
top  software  issues  identified  by  the 
NDIA  [12].  The  most  current  source 
turned  out  to  be  a  systemic  analysis  of 
software  issues  found  in  DoD  reviews 
of  acquisition  programs  [13]. 

Components  of  the  Framework 

The  SATEWG  framework  consists  of 
the  following: 

•  Knowledge  Areas  (4):  High-level 
descriptions  of  the  overarching  skills 
that  make  up  the  software  elements 
of  the  job. 

•  Competencies  (29):  Definitions 
that  provide  information  at  a  gener¬ 
alized  level  that  allows  flexibility  for 
cross-functional  comparison.  Com¬ 
petencies  describe  the  job  require¬ 
ments  and  individual  capabilities  at  a 
broader,  more  process-oriented  level 
than  a  single  knowledge,  skill,  or  abil¬ 
ity.  There  are  multiple  competencies 
under  each  knowledge  area. 

The  SATEWG  decided  not  to  identi¬ 
fy  the  specific  performance  outcomes 
for  each  competency  (i.e.,  the  behav- 
ior[s]  an  employee  must  demonstrate  for 


successful  job  performance).  These 
expected  outcomes  will  vary  from  career 
field  to  career  field.  Instead,  the 
SATEWG  decided  that  the  performance 
outcomes  should  be  defined  by  the 
groups  that  manage  each  career  field. 

The  framework  contains  software 
knowledge  areas  and  competencies  with¬ 
in  each  knowledge  area  (see  Table  1). 

Applying  the  Framework 

The  SATEWG  uses  the  software  compe¬ 
tency  framework  to  work  closely  with  each 
career  field  to  help  integrate  software 
expertise  into  their  existing  competency 
models. 

The  SATEWG  started  working  with 
the  SPRDE  expert  panel  to  integrate  soft¬ 
ware  into  their  draft  SPRDE  competency 
model.  The  SATEWG  identified  the  key 
competencies  from  a  software  perspective, 
while  the  SPRDE  expert  panel  identified 
the  key  software  competencies  from  their 
perspective.  Using  the  competency  frame¬ 
work,  die  SATEWG  and  SPRDE  expert 
panel  tailored  the  software  competencies 
to  the  needs  of  the  engineering  workforce. 
The  final  SPRDE  career  field  model  now 
contains  13  elements  that  address  soft¬ 
ware;  more  specifically,  14  of  the  frame¬ 
work  competencies  in  Table  1  (marked 
with  a  “*”)  were  mapped  to  the  final 
SPRDE  model. 

The  SATEWG  followed  a  similar 
process  for  both  the  Test  &  Evaluation 


and  Production,  Quality  &  Manufactur¬ 
ing  career  fields.  The  software  compe¬ 
tency  framework  allows  the  SATEWG 
to  provide  input  to  the  expert  panels  of 
each  career  field  that  is  consistent — as 
well  as  customized — to  the  needs  of 
each  career  field. 

The  SATEWG  has  also  started  the 
process  of  identifying  gaps  in  the  exist¬ 
ing  software  acquisition  curricula.  To 
conduct  this  analysis,  the  SATEWG  uses 
the  software  competency  framework,  as 
well  as  the  DAU’s  terminal  and  enabling 
learning  objectives  from  their  software 
acquisition  management  courses. 

Future  Direction 

While  the  SATEWG  remains  focused  on 
the  goals  outlined  by  the  original  charter, 
members  are  identifying  opportunities 
that  go  beyond  it.  These  efforts  further 
bridge  the  gap  between  current  and 
desired  software  proficiency  and  also 
reach  a  new  audience:  software  experts 
who  are  critical  in  managing  the  com¬ 
plexity  of  today’s  software -intensive  sys¬ 
tems.  Such  efforts  include: 

•  Formally  validating  the  framework. 

•  Fostering  a  learning  environment 
and  addressing  the  training  needs  of 
software  experts. 

•  Establishing  a  government-wide 
occupational  career  code  for  soft¬ 
ware  engineering. 

The  SATEWG  will  start  pursuing  these 
additional  efforts  when  the  elements  of 
the  original  charter  are  met.  Current 
goals  and  future  efforts  will  require  sup¬ 
port  and  collaboration  with  software 
and  human  capital  leaders  across  the 
DoD.  The  SATEWG  will  continue  to 
apply  a  collaborative  approach  to  ensure 
continued  success. 

The  SATEWG  welcomes  the  in¬ 
volvement  of  software  and  human  capi¬ 
tal  leaders  across  the  DoD.  Please  con¬ 
tact  the  author  if  you  would  like  to 
receive  more  information  about  the 
SATEWG’s  efforts. 

Conclusion 

Several  studies  conducted  recently  have 
highlighted  both  the  human  capital  and 
software-related  issues  facing  the  DoD. 
To  address  the  growing  concern  regard¬ 
ing  software  complexity  and  the  capaci¬ 
ty  of  the  acquisition  workforce,  the 
SATEWG  has  made  strides  to  ensure 
that  software-related  skills  are  both 
embedded  in  competency  models  and 
fostered  within  existing  curricula. 

The  efforts  of  the  SATEWG  have 
led  to  the  development  of  a  framework 


Table  1:  SATEWG  Software  Coenpetency  Framework  Summary 


Knowledge  Area 

Competencies 

1.  Software  Acquisition  and  Sustainment  Planning:  The 

activities  used  to  plan  for  the  acquisition,  development,  and 
sustainment  of  software  across  the  life  cycle. 

1 .  Software  Impact  on  Acquisition  Strategy* 

2.  Software  Planning* 

3.  Software  in  the  Work  Breakdown  Structure 

4.  Integrated  Master  Plan/Integrated  Master  Schedule 

5.  Planning  for  Software  Transition  and  Sustainment 

2.  Software  Development  Considerations:  Software 
development  is  a  process  of  defining  and  executing  software 
solutions  from  system-level  requirements,  which  have  been 
allocated  to  software.  This  includes  the  life-cycle  activities  such 
as  designing,  developing,  integrating,  and  testing  of  the 
software  components  of  a  system.  It  also  includes  design 
considerations  such  as  compatibility,  extensibility,  fault- 
tolerance,  maintainability,  packaging,  reliability,  reusability, 
security,  and  usability,  as  well  as  the  development  of 
associated  documentation. 

6.  Software  Architecture* 

7.  Software  Requirements* 

8.  Integration  of  Software  and  Systems  Engineering* 

9.  Software  Design* 

10.  Software  Development  Methodology 

11.  Software  Integration* 

12.  Software  Interface  Management 

13.  Software  Modeling  and  Simulation 

1 4.  Verification  &  Validation  of  Software 

15.  Software  in  Systems  Engineering  Plans 

16.  Software  Interoperability* 

1 7.  Software  Safety* 

1 8.  Software  Security* 

19.  System  and  Software  Engineering  Environment 

20.  Software  Trade  Studies 

3.  Software  Management:  Establishes  a  common  framework 
for  software  life-cycle  processes,  with  well-defined  terminology 
that  applies  to  the  acquisition  of  systems  and  software  products 
and  services,  to  the  supply,  development,  operation, 
maintenance,  and  disposal  of  software  products,  and  to  the 
software  portion  of  a  system. 

21 .  Software  Configuration  and  Data  Management 

22.  Software  Risk  Management* 

23.  Software  Technical  Reviews 

24.  Software  Quality  Assurance* 

25.  Software  Financial  Management  and  Estimation* 

26.  Software  Contracting  Considerations 

27.  Software  Measures* 

4.  Post-Deployment  Software  Support:  The  planning, 
sustainment,  and  management  activities  related  to  the 
performance  of  preventative,  predictive,  scheduled,  and 
unscheduled  actions  aimed  at  maintaining  or  improving 
software  performance  (e.g.,  functionality,  efficiency,  reliability, 
availability,  maintainability,  security,  and  safety). 

28.  Transition  to  Sustainment 

29.  Sustainment 
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which  lists  the  critical  software  compe¬ 
tencies  that  are  cross-functional  and  can 
be  customized  for  each  career  field  in 
the  DoD.  The  SATEWG  also  uses  this 
framework  to  review  existing  courses  to 
ensure  that  the  acquisition  workforce  is 
being  trained  in  the  necessary  areas  of 
software.^ 
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Coming  Events 


June  6- 1  I 

Association  for  Computing  Machinery 
SIGMOD/PODs  Conference 
Indianapolis,  IN 

www.sigmod20 1 0.org 

June  27- July  I 

Cisco  Live!  2010 
Las  Vegas,  NV 

www.cisco-live.com 

June  28-30 

Command  and  Control  Summit  2010 
Washington,  D.C. 

www.C2Event.com 

July  1-3 

22A  International  Conference  on 
Software  and  Knowledge  Engineering 
Redwood  City,  CA 

www.ksi.edu/seke/seke  I  O.html 

July  12-15 

20'1’  Anniversary  INCOSE  International 
Symposium  2010 
Chicago,  IL 

www.incose.org/symp20 1 0 

July  25-29 

3411'  Annual  IEEE  Computer  Software 
and  Applications  Conference 
Los  Angeles,  CA 

www.siggraph.org/s20 1 0 

August  9- 1 3 

Agile  Conference  2010 
Nashville,  TN 

http://agile20 1 0.agilealliance.org 

August  15-19 

30'1’  International  Cryptology  Conference 
Santa  Barbara,  CA 

www.iacr.org/conferences/ 
crypto20 1 0 


Coming  Events:  Please  submit  coming  events  that 
are  of  interest  to  our  readers  at  least  90  days 
before  registration.  E-mail  announcements  to: 
<marek.steed.ctr@hill.af.mil>. 
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